Thermodynamic constraints on fluctuation phenomena 
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The relationships between reversible Carnot cycles, the absence of perpetual motion machines 
and the existence of a non-decreasing, globally unique entropy function forms the starting point of 
many textbook presentations of the foundations of thermodynamics. However, the thermal fluctu- 
ation phenomena associated with statistical mechanics has been argued to restrict the domain of 
validity of this basis of the second law of thermodynamics. Here we demonstrate that fluctuation 
phenomena can be incorporated into the traditional presentation, extending, rather than restricting, 
the domain of validity of the phenomenologically motivated second law. Consistency conditions lead 
to constraints upon the possible spectrum of thermal fluctuations. In a special case this uniquely 
selects the Gibbs canonical distribution and more generally incorporates the Tsallis distributions. 
No particular model of microscopic dynamics need be assumed. 

PACS numbers: 05.70.-a,05.40.-a 
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I. INTRODUCTION 

The existence of a globally unique entropy as a func- 
tion of thermodynamic state, which is non-decreasing in 
time, is one of the central tenets of classical phenomeno- 
logical thermodynamics [HQ. By contrast, the meaning 
of entropy within the context of statistical mechanics 
seems to defy consensus(see [1, 01 for examples). Since 
the start of statistical mechanics there has been con- 
cern that the existence of fluctuation phenomena leads 
to violations of the second law of thermodynamics. This 
may lead to decreases in entropy, the existence of per- 
petual motion machines or maybe even the inability to 
define an entropy at all. Maxwell's demon represents 
a persistent strand of thourfit experiments dedicated to 
exploring these possibilities]!, |^, Q . 

Most attempts to construct a second law of thermo- 
dynamics for statistical mechanics involve one of two 
strategies: restrict the domain of validity of the classical 
statement (usually to reliable, continuous processes) so 
as to exclude fluctuation phenomena; or to attempt to 
derive a new second law within the domain of statistical 
mechanics. Here we investigate the possibility of a third 
approach: to extend the domain of the phenomenolog- 
ical second law to include, constrain, and predict the 
extent of the fluctuation phenomena, which reduces to 
the more familiar version if fluctuation phenomena are 
absent. We find that such an extension seems, in princi- 
ple, possible, and that with additional work it is possible 
to define an entropy function consistent with this. Some 
possible relationships of this fluctuation second law to 
conventional statistical mechanics can be inferred. 

The approach of the paper is as follows. Section 2 
briefly reviews the equivalence of the Kelvin, Clausius 



and Carnot versions of the second law of thermody- 
namics. Section 3 then proposes an extension of the 
Kelvin version, to incorporate fluctuation phenomena. 
Logically equivalent generalisations of the Clausius and 
Carnot versions are deduced, and some constraints are 
deduced about the form of the extended second law. Sec- 
tion 4 reviews the derivation of an entropy function and 
shows when the existence of a fluctuation entropy func- 
tion can be deduced. Finally Section 5 considers some 
relationships to statistical mechanical entropies, includ- 
ing the Gibbs and TsallisQ entropies. 



II. PHENOMENOLOGICAL SECOND LAW 

Textbook versions of the Second Law of Thermody- 
namics (see, for example, d, [13)) when expressed in 
terms of heat flows and heat baths, take forms such as: 

• Kelvin: No process is possible whose sole result 
is the extraction of heat from a heat bath and its 
conversion to work. 

• Clausius: No process is possible whose sole re- 
sult is the transfer of heat from one heat bath to 
another heat bath at a higher temperature. 

• Carnot Heat Engine: No heat engine operating 
between heat baths at temperatures Ti < T2 can 
operate at an efficiency ue exceeding the efficiency 
of a reversible heat engine: ue ^ ncE = 1 
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• Carnot Heat Pump: No heat pump operating 
between heat baths at temperatures Ti < T2 can 
operate at an efficiency n p exceeding the efficiency 
of a reversible heat pump: np < ncp — t^-Ti 

Demonstration of the logical equivalence of each pair 
of these statements can easily be found in a textbook 
such as jlOl] . The equivalence is typically proven by the 
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(a)np = TT^ < ncp 



{h)nE = TT < ^CE 



FIG. 1: Reliable Heat Pumps and Engines 



the second law^. 

The problem arises that fluctuation phenomena, such 
as Brownian motion, do, in principle, violate all these 
statements of the second law, when probabilistic pro- 
cesses are allowed. Attempts to define a modified sec- 
ond law will typically restrict the domain of validity. It 
may be suggested that the second law only applies to 
the thermodynamic limit of an infinite number of atoms, 
where fluctuations become negligible, or it may be sug- 
gested that the second law only applies to continuous or 
reliable processes: 

• No reliable process is possible whose sole result is 
the extraction of heat from a heat bath and its 
conversion to work. 



means of diagrams such as in Figure [3 This diagram 
shows the combination of heat engine and heat pumps 
being used to attempt violations of the Kelvin and Clau- 
sius statements. Figure 2(a) shows that if a heat pump 
can operate with efficiency Hp — ^ > ncp — 
then in combination with a reversible heat engine op- 
erating at ncE = ^ there is a net conversion of 
Wc — Wp > heat from the lower temperature heat 
bath into work, violating the Kelvin statement. Sim- 
ilarly Figure 2(b) shows a heat engine operating with 



efficiency Uf, — > ncE — ^ can be combined with 

a reversible heat pump operating at ncp = ^ could 
transfer heatQc — Qe > from a colder to hotter heat 
bath without requiring work, thus violating the Clausius 
statement. It should be noted that this demonstration 
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FIG. 2; Equivalencies of Violations of Second Laws 



requires a number of usually unstated assumptions, such 
as the absence of negative temperatures. In particular, 
the equivalence requires it to be physically possible to 
construct a reversible heat engine or pump. For exam- 
ple, if it were not physically possible to build a heat 
engine whose efficiency could reach that of a theoreti- 
cal reversible heat engine, then it would not necessarily 
follow that a real heat pump exceeding the Carnot ef- 
ficiency could violate the Kelvin or Clausius versions of 



• No process is possible with probability one, whose 
sole result is the extraction of heat from a heat 
bath and its conversion to work. 

• No continuously operating process is possible 
whose sole result is the extraction of heat from a 
heat bath and its conversion to work. 

• No process is possible whose sole result is, on av- 
erage, the extraction of heat from a heat bath and 
its conversion to work. 

Restricting the domain of validity in this way, how- 
ever, proves unable to provide answers to many interest- 
ing questions about the thermodynamic consequences of 
fluctuation phenomena. Can systems with a finite num- 
ber of atoms be used to continuously, reliably convert 
heat to work? If a process can succeed with probabil- 
ity less than one, how much work can be extracted? If 
a process only operates for a finite amount of time how 
much work can be extracted? Can it be arbitrarily large? 
Can a process exist which can extract an arbitrarily large 
quantity of work with probability arbitrarily close to one, 
while still failing on average due to catastrophic failure 
when it does fail? 

This can be illustrated by considering a hypothetical 
family of processes, parameterised by > 1. Process N 
will, with probability 1 — jj, generates N units of work 
from heat, but with probability it requires N"^ units of 
work to be dissipated. The mean work produced is —1, 
regardless of the value of N, but as iV ^ cx) arbitrarily 
large amounts of work are produced with probability ar- 
bitrarily close to one. Even more extreme examples can 
easily be constructed. Such a family of processes satisfies 
several of the restricted laws above, but does not accord 
with our experience of fluctuation phenomena. 



Suppose for all real heat engines rie < Umax < ncE- AH that 
could be implied would be that the efficiency of real heat pumps 
were bounded by rip < — but — > ncp. Note that such 
a heat pump, with rip > ncp, would not be possible to operate 
rcvcrsibly as a heat engine. 



III. FLUCTUATIONS AND THE SECOND LAW 

In this Section the main argument of the paper will 
be explored. Rather than follow the path of the modi- 
fications in Section [III restricting the domain of validity 
of the second law so as to exclude fluctuation phenom- 
ena, it will instead be expanded to include fluctuation 
phenomena. Fluctuations will be treated as being prob- 
abilistic processes, occurring with probability less than 
one. The modified law should set a constraint upon the 
size of fluctuations that can occur, and should reduce to 
the fluctuation-free second law when only deterministic 
processes occur. 

The proposed modification to the phenomenological 
second law is based upon nothing more than the obser- 
vation that the greater the size of the fluctuation, the 
less probable its occurrence. From this it is proposed 
that, for a given size of fluctuation, there is a maximum 
possible likelihood of it occurring: 

There is no cyclic process^, whose sole re- 
sult is the extraction of a quantity of heat, 
Q, from a heat bath at temperature T, and 
its conversion to work, which can occur with 
probability p, unless: 



P<f{Q,T) 



(1) 



where / is a function whose properties will be deduced 
from internal consistency. The definition is such that it 
is assumed for any given Q and T there exists an ac- 
tual physical processes which can get arbitrarily close to 
occurring with probability f{Q,T). If not, then there 
must exist a lower value of / that should have been used 
instead. 

It is possible to immediately note some properties of /: 
as the function bounds a probability, it cannot become 
negative; it is always possible to dissipate work as heat; if 
there is a process that extracts Q' > Q with probability 
p, then by also dissipating work W = Q' — Q, there 
is a process that extracts Q with probability p. These 
immediately constrain the function: 



fiQ,T) > 
/(Q,T) = 1 VQ<0 
/(Q,T) > /(Q',T) VQ'> 



(2) 
(3) 
(4) 



The last condition implies that if / is also a differentiablc 
function of Q, then 



9/ 
dQ 



< VQ 



(5) 



^ When discussing probabilistic cycles, a cyclic process will mean 
a process which returns to its original state with probability p, 



but with probability 1 
starting point. 



p may end up in a different state to its 



One trivial solution would be: f{Q,T) = 0, VQ > 0. 
This would correspond to all fluctuations being forbid- 
den. At the other extreme, f{Q, T) = I, VQ would 
imply one could get arbitrarily close to any size of fluc- 
tuation, at any probability. 

This is a more restrictive condition than the mean 
conversion of heat to work over cycle being negative, 
although it does imply it. The proof of this is straight- 
forward. If there exists a process which can produce a 
positive expectation value for production of work over 
a single cycle, then repeating that cycle a large number 
of times produces an expectation value as large as one 
likes, with a gaussian spread around that mean. The 
probability that any given quantity of work can be ex- 
ceeded becomes close to one. Hence any process which 
can produce a positive expectation value for work will, 
on repeated application, exceed any function / < 1. 

This kind of fluctuation - extracting work from a single 
heat bath - will be called a Kelvin fluctuation, and be 
represented as in Figure 3(a) showing W work being 



extracted from a heat bath at temperature Ti 
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T 

(a) (b) 
FIG. 3: Kelvin and Clausius Fluctuations 

The equivalence of Kelvin fluctuations to other kinds 
of fluctuations will now be demonstrated. 

A. Kelvin and Clausius Fluctuations 



A Clausius fluctuation, as in Figure [3(b)[ will denote 
the spontaneous transfer of Q work from a heat bath at 
Ti to a heat bath at T2 > Ti occurring with a maxi- 
mum probability /c(Q, 7i, T2). One way t o achieve a 
Clausius fluctuation is given in Figure 4(a) combining 



a Kelvin fluctuation with a reliable Carnot pump op- 
erating at efficiency ncp — w ~ t^-T2 ' "^^^^ "^^^ o*^" 
cur with probabihty /(VF, Ti), so fc{Q, Ti,T2) cannot be 
less than this: fc{Q,Ti,T2) > f{W,Ti) = fi^,Ti). 
A Kelvin fluctuation can similarly (Figure [4(b)[ ) be cre- 
ated from a Clausius fluctuation, by allowing the heat Q 
from the Clausius fluctuation to drive a reliable Carnot 
engine at efficiency ncE — ^ — 1 ~ i^- This implies 
/c(Q,Ti,r2) < /(IF,Ti) = fiQncE^Ti) and ncE = 
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FIG. 4: Converting Kelvin and Clausius Fluctuations 
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FIG. 6: Kelvin Fluctuations and Fluctuation Heat Pumps 
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FIG. 5: Fluctuation Heat Pumps and Engines 
B. Kelvin, Clausius and Heat Pump Fluctuations 



A fluctuation heat pump (Figure[5(a) ) is a heat pump 



that is able to operate with a higher efficiency than a 
reversible Carnot heat pump, but only with a probabil- 
ity less than one of success. The maximum probabil- 
ity of success, fp{W,np,Ti,T2) of achieving efficiency 
np = > ricp can be deduced either from the Kelvin 
fluctuation law (FigurelH]) or the Clausius fluctuation law 
(Figure [7]). In the Figure 6(a) creating a fluctuation 



pump with efficiency np = > ncp, by augmenting 
the behaviour of a regular Carnot pump with a Kelvin 
fluctua tion shows /p(VF, np, Ti, T2) > f{Qi,Ti) . In 
Figure [6(b)| creating a Kelvin fluctuation of size Qi, by 
extracting the heat pumped by fluctuation heat pump 
at efficiency np — > ncp, and using it to drive a 



Carnot heat engine gives /(Qi,Ti) > fp{W,np,Ti,T2) 
Substituting Qincp = W{np — ncp) gives 



fpiW,np,Ti,T2)^ f[W 



np 
ncp 



1 ,Ti 



(7) 



Figure 7(a) augments the Carnot heat pump with a 
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FIG. 7: Clausius Fluctuations and Fluctuation Heat Pumps 

Clausius fluctuation of size Qi to create a fluctuation 
pump of efficiency np — ^ > ncp- Now using the work 
extracted from a Carnot engine to drive a fluctuation 
heat pump, gives a Clausius fluctuation in Figure [7(b)| 
Combined fp{W, np,T^,T2) = /c(Qi, Ti, T2) with Qi = 
W{np — ncp), so 

fpiW,np,Ti,T2) = fciW{np-ncp),Ti,T2) (8) 

It can be easily confirmed that this is consistent with the 
relationship fc{Q,Ti,T2) = fi^,Ti). 



C. Kelvin, Clausius and Heat Engine Fluctuations 



Similarly, a fluctuation heat engine (Figure 5(b) I is 
a heat engine that can operate with a higher efficiency 
than a reversible Carnot heat engine, but only with a 
probability less than one of success. 



Augmenting a Carnot heat engine with a Kelvin fluc- 
tuation of size Qi, Figure 8(a) creates a fluctuation 



heat engine, while using the heat pumped by a reg- 
ular Carnot pump to drive a fluctuation heat engine, 
Figure 8(b) creates an equivalent Kelvin fluctuation. 



Giving the maximum probability achievable for a flue- 
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D. Heat Pumps and Engines 

It is now possible to compare the expressions 
for fE{Q,nE,Ti,T2) and /p(VF, np, Ti, T2) directly 
This gives fE{Q,nE,Ti,T2) = /p(W^, np, Ti, Ta) if 
W (^1^^ — 1^ = Q (nE — ^ce)- To confirm consistency 
this can also be derived from the diagrams in Figure 
[TUl In Figure 10(a) a fluctuation heat engine, oper- 







Q, 












Q- 



FIG. 8: Kelvin Fluctuations and Fluctuation Heat Engines 

tuating heat engine to extract heat Q from a heat bath 
at temperature with efficiency ue = ^ > ncE, de- 
positing the remainder in a heat bath at temperature 
Ti < T2 a,s fE{Q,nE,Ti,T2), the diagrams quickly yield 
Qi — Q{nE — ncE) and the relationship 



fE{Q,nE,Ti,T2) = fiQiriE ~ ncE),Ti) 



(9) 



Figure [H provides the equivalent analysis for Clausius 
fluctuations, now creating a Clausius fluctuation by driv- 
ing a regular Carnot pump with the work extracted by 
a fluctuation heat engine. As QiUce = QijiE — uce) 



(a) 



(b) 



FIG. 10: Fluctuation Heat Pumps and Engines 



ating at ue = -g^ improves the efficiency of a Carnot 
heat pump, by using some of the pumped work to re- 
turn a higher proportion of the heat into work, to cre- 
ate a fluctuation heat pump, with efficiency np = ^f-. 



In Figure 10(b) a fluctuation heat pump, with effi- 
ciency np 



^ improves the efficiency of a Carnot 



heat engine to create a fluctuation heat engine with ef- 
ficiency Ue — It can readily be conflrmed that 

W ' 



{f^,~'^-Q^^E-ncE). 
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FIG. 9: Clausius Fluctuations and Fluctuation Heat Engines 



Ue 



fEiQ,nE,Ti,T2) = fc [Q 



ncE 



1 ,ri,T2 (10) 



Again, this is consistent with the relationship between 
fc and /. 



E. Heat and Temperature 

There remains six diagrams for fluctuations involving 
two heat baths. These diagrams determine the relation- 
ship between Kelvin fluctuations at different tempera- 
tures. Figure [TT] shows how a Kelvin fluctuation can 
be converted to an equivalent Kelvin fluctuation at a 
higher or lower temperature, by using a Carnot pump or 
engine. This supplies heat from a second bath to replace 
the heat obtained from the fluctuation. The overall pro- 
cess is then a Kelvin fluctuation from the second heat 
bath. 



From Figure [11 (a) it can be seen that the probability 
of obtaining a Kelvin fluctuation of size Q2 at tempera- 
ture T2 cannot be less that the probability of obtaining 
a Kelvin fluctuation of size Qi at temperature Ti, pro- 
vided Si 



Q2 
T2 



/(g2,T2)>/(Qi,Ti) 



(11) 



Figure 11(b) shows the reverse process, for which 
/(Q2,T2T^/(Qi,Ti), so /(gi,Ti) - /(g2,T2) when 



heat engine, ncE, with probabiUty p, unless: 
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FIG. 11: Kelvin Fluctuations at Different Temperatures 



= Q^, Writing a = ^ this leads to fiQ,T) = 
f{aQ,aT). As this must hold for all Ti and T2, and so 
for all a 



(12) 



The remaining four diagrams are essentially the same 
as the diagrams in Figures 21 8(b) and 6(b) except they 



involve a Kelvin fluctuation from the higher temperature 
heat bath. Comparison of these processes again leads to 
Equation [T2l 



F. Fluctuation Friendly Second Law 



Combining the result from Section HIT El with those 
from Sections IIII Al to IIII Dl it is now possible to state 
the fluctuation compatible generalizations of the formu- 
lations of the Second Law of Thermodynamics given in 
Section n] 

• Kelvin: There is no process, whose sole result is 
the extraction of a quantity of heat, Q, from a heat 
bath at temperature T, and its conversion to work, 
which can occur with probability p, unless: 



Clausius: There is no process, whose sole result 
is the extraction of a quantity of heat, Q, from a 
heat bath at temperature Ti, and its transfer to 
a heat bath at temperature T2 > Ti, which can 
occur with probability p, unless: 



P<f 



1 



1 



Heat Engine: There is no cyclic process, operat- 
ing solely as a heat engine between heat baths at 
temperatures T2 > Ti, which can extract a quan- 
tity of heat, Q, from the hotter heat bath, with ef- 
ficiency He exceeding that of a reliable, reversible 



P<f 



{uE - tlce) 



• Heat Pump: There is no cyclic process, operat- 
ing solely as a heat pump between heat baths at 
temperatures T2 > Ti, which can use a quantity 
of work, W , with efficiency np exceeding that of a 
reliable, reversible heat engine, ncp, with proba- 
bility p, unless: 



^ f,W f np 



Ti \ncp 



1 



These four formulations are logically equivalent, in 
the same manner that the four formulations of the 
fluctuation-free second law given in Section M are log- 
ically equivalent. 



G. Kelvin-Clausius inequality. 

These four formulations can be expressed in the same 
way. Combining a single fluctuation with Carnot pumps 
and engines connecting heat baths at multiple temper- 
atures reveals that there is a more general formulation 
of the fluctuation laws. Just as all four of the normal 
phcnomenological laws may be seen as special cases of 
the law: 

There is no process, whose sole result is the 
extraction of quantities of heat, Qi, from 
heat baths at temperatures Ti, converting 
the net heat extracted into work, unless: 



so all of the fluctuation laws are special cases of: 

There is no process, whose sole result is the 
extraction of quantities of heat, Qi, from 
heat baths at temperatures Ti, converting 
the net heat extracted into work, which can 
occur with probability p, unless: 



(13) 



(14) 



The general formulation should make clear the role that 
Carnot cycles plays within the derivation of the specific 
fluctuation laws. Carnot pumps and engines connecting 
a number of different heat baths are able to reversibly 
move heat between them in any combination provided 
the net effect is J2i = 0. Any given fluctuation can 
therefore be converted into another fluctuation, involv- 
ing different heat baths, but which has the same value 



H. Combining fluctuations 

The next stage is to consider combining fluctuations, 
by diagrams involving more than one fluctuation. As it 
turns out, only two diagrams, Figure [T^ are required to 
deduce the general relationship. 



G, Q2 



T 



(a) (b) 
FIG. 12: Combining Kelvin Fluctuations 



In Figure 12(a) there is a single Kelvin fluctuation re- 
sulting in Qi + Q2 heat extracted from a heat bath at 
temperature T. One possible way of this happening is if 
two independent processes occur, each from heat baths 
at temperature T, resulting in two separate Kelvin fluc- 
tuations, extracted Qi and Q2 heat, respectively. Figure 
|12(b)| gives a process by which Q1 + Q2 can be extracted, 
so the minimal probability of a Kelvin fluctuation of that 
size cannot be less that the probability of the two inde- 
pendent fluctuations both occurring: 



(15) 



As this must happen for all Qii Q2, the fluctuation law 
must satisfy the general functional inequality'^ 

f{x + y)>f{x)f{y) (16) 

This leads directly to the general equation 



> 



n/ 



(17) 



that would also be deduced from considering diagrams 
with multiple fluctuations and with Carnot pumps and 
engines operating between multiple heat baths. 

This property in itself can be used to demonstrate 
that, if there exists some x — xo > such that /{xq) = 
then it must be the case that \/x > 0, f{x) = 0, i.e. 



^ This may be converted into a more familiar form using F(x) = 
— ln[/(x)] to get F{x) + F{y) > F{x + y). In passing, it may 
also be noted that if f{x) is differentiable, then it can be shown 
from Equation [16] that f'{x) > f{x)f'{0) and /"(O) > /'(O)^. 
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fluctuations must be possible at all scales, if they are 
possible on any scale. Intuitively this should be obvi- 
ous: provided a small fluctuation can occur with a non- 
zero probability, p, then accumulating n such fluctua- 
tions into a fluctuation n times large is always possible 
with probability p". Any size of fluctuation may occur 
with small, but non-zero probability, provided n is large 
enough. 

If it were the case that accumulating small fluctuations 
was the optimum process for obtaining a large fluctua- 
tions, then: 



Q^ 



T, 



(18) 



This requires f{x + y) = f{x)f{y). Provided / is a 
continuous function, this has a unique solution: 




(19) 



where A is a universal constant whose value would need 
determining experimentally to be the reciprocal of Boltz- 
mann's constant: A — k~^. 

It is, perhaps, surprising that such a familiar function 
within statistical mechanics might be obtained from the 
purely phenomenological arguments followed here! Un- 
fortunately, there seems no strong reason to demand that 
a large fluctuation cannot, in principle, be more probable 
than getting an equivalent sized fluctuation through the 
accumulation of a large number of small fluctuations. 
It may, on the arguments considered so far, simply be 
the case that large fluctuations can spontaneously oc- 
cur, with a higher probability. 

Equation [12] is not the only possibility. The restric- 
tions on the form of f{x) are 



fix) > 

fix) = 1 
dl 

dx 

fix + y) >fix)fiy) Va;,y>0 



< 



Vx < 
Vx > 



(20) 
(21) 

(22) 

(23) 



Other functions which could satisfy all these require- 
ments include: 



1. 



fix)^ 



1 + 



(24) 



will satisfy all the conditions specified whenever 
ri!a„ < m\l\am,ai for all n = m + I. Specific cases 
include: 

(a) nlun = mUlamCii. This leads to a„ = 

/e(x) = e--'- (25) 

(b) For aU n > 1, let a„ = 



f^ix) 



1 



1 + aix 



(26) 



(c) If some f{x) that satisfies the conditions, then 
g{x) = /"(x), with n > 1 will satisfy the 
conditions, so 



1 



(1 + aia;)i/°i 
with < ai < 1. 
2. An even slower falling function such as 



(27) 



(28) 



1 + ln(l + ax) 
can also satisfy the requirements. 

IV. FLUCTUATIONS AND ENTROPY 

In Section Hill it was shown that the Kelvin-Clausius- 
Carnot versions of the second law, formulated in terms 
of cyclic processes and heat baths, can be generalised 
in a consistent way to include fluctuation phenomena. 
However, phenomenological thermodynamics does not 
become genuinely powerful until Equation 1131 is used to 
define a non-decreasing, global function of state called 
entropy. With fluctuations possible, it is clear that any 
such globally defined function of state can decrease with 
some probability. In this Section it is shown that it is still 
possible to define a meaningful entropy function, with a 
relationship to the fluctuation law in Equation 1141 

A. Phenomenological Entropy 

The Kelvin-Clausius inequality: 

There is no process, whose sole result is the 
extraction of quantities of heat, Qi, from 
heat baths at temperatures Ti, converting 
the net heat extracted into work, unless: 



E 



T, 



< 



immediately implies that, if there exists a process, whose 
sole result is to transform state A, into state B, while 
extracting quantities of heat, Q[^^\ from heat baths 
at temperatures Ti, then there is no process whose sole 
result can be to transform state B into state A, while 



extracting quantities of heat, Q 
temperatures Ti, unless: 



(BA) 



, from heat baths at 



< 



(29) 



It is a straightforward mathematical construction (see 
Appendix J to show this implies the existence of a non- 
empty convex''^ set of functions of state, {Sg{X)}, which 



* For any two S,S' G {Sg{X)} then for any < p < 1, it is the 
case that pS + {I - p)S' £ {Se{X)}. 



each satisfy the following condition: 

If there exists a process, whose sole result is 
to transform state A into state B, while ex- 
tracting quantities of heat, Q\'^^\ from heat 



baths at temperatures T,;, then 



Sg{A)<Sg{B)~Y. 



Q 



(AB) 



(30) 



The functions Se{X) will be referred to as thermody- 
namic entropies. 

The expression of the phenomenological second law, 
in terms of these thermodynamic entropies, is 

There exist functions of the thermodynamic 
state {Se{X)}, such that for any two thermo- 
dynamic states A and B, there is no process, 
whose sole result is to transform state A into 
state B, while extracting quantities of heat 



.(AS) 

unless 



from heat baths at temperatures Tj, 



SeiA) <SeiB)~J2 



Q 



(AB) 



T,, 



(31) 



for all SeiX). 



In an adiabatic process, no heat is extracted or generated 
in any heat bath, so this requires Se{A) < Se{B). 

As this result must also hold for processes which trans- 
form B into A, then 



^(AB) ^{BA) 

Y.%-<Se{B)-So{A)<-J2'^^ 



T,, 



(32) 



This must hold for all processes, so the set {Se{X)} is 
bounded by the processes which maximise the quantities 



and J2 



If the two states A and B can be connected by a re- 
versible cycle, then the maximum reached is 



E 



Q 



(AB) 



E 



Q 



(BA) 



(33) 



in which case the entropy difference between the two 
states is fixed to be the same value for all functions in 
{Se{X)}: 



SgiB)-Sg{A)=J2- 



^(AB) 



E 



Q 



(BA) 



(34) 



If all states can be connected by reversible cycles, then 
there is a single function, unique up to an additive con- 
stant. It is important to note that reversibility is re- 
quired for the uniqueness of the entropy function, but is 
not necessary to prove the existence of a non-decreasing 
set of entropy functions. 



B. Fluctuation Entropy law 

The existence of the fluctuation law does not prevent 
the derivation of the existence of the thermodynamic en- 
tropy functions {Sg{X)}. Their significance is restricted 
to reliable (i.e. probability one) processes. Unfortu- 
nately it does not immediately follow that a fluctuation 
law can be deduced constraining the probability of a re- 
duction in thermodynamic entropy. 

An essential stage in the deduction of a law relating 
entropy to fluctuations, is the identification of an appro- 
priate inequality for closed cycles incorporating any two 
states, such as Equation[5Sl but for cycles involving fluc- 
tuations. Such an inequality cannot be directly obtained 
from the fiuctuation law. 

The fluctuation law, Equation (fT4| . implies that, if 
there exists a process, whose sole result is to transform 
state A, into state B, while extracting quantities of heat, 
q{AB} ^ from heat baths at temperatures T^, and which 
can occur with probability pab , then there is no process 
whose sole result can be to transform state B into state 
A, while extracting quantities of heat, Q\^^\ from heat 
baths at temperature Ti , which can occur with probabil- 
ity Pea, unless: 



PABPBA<f(Y.%^+Y. ' 



T, 



(35) 



ated in heat baths at temperatures Ti , for a process that 
can occur with probability one, and whose sole effect, 
apart from extracting heat from heat baths and convert- 
ing them to work, is to transform state A into state B. 
It follows that there is no process, whose sole result is to 
transform state B into state A, while extracting quanti- 
ties of heat Q[^^^ from heat baths at temperatures Ti, 
which can occur with probability pba, unless 



r'{PBA)>J2- 



AAB) 



T, 



E 



Q 



{BA) 



T, 



(38) 



Similarly, if q\^^'^ is the heat generated in heat baths 
at temperatures T^, for a process that can occur with 
probability one, whose sole effect, apart from extracting 
heat from heat baths and converting them to work, is 
to transform state B into state A, then there is no pro- 
cess, whose sole result is to transform state A into state 
B, while extracting quantities of heat Q\^^^ from heat 
baths at temperatures Ti, which can occur with proba- 
bility Pab, unless 



r\PAB) > E 



(AB) 



T, 



E 



Ti 



(BA) 



T 



(39) 



Inverting the function gives: 



/ ^{pabPba) > ^ 



Q. 



(AB) 



T, 



E 



Q. 



(BA) 



T 



(36) 



However, the relationship f{x + y) > f{x)f{y), when 
inverted, yields 



r\pq)>f-'{p) + f-\q) 



(37) 



and this does not allow the deduction of a suitable in- 
equality. 

1. Reliable Paths 

To proceed further, it is necessary to consider reliable 
paths between A and B. Let Qj-'^'^'' be the heat gener- 



It is immediately possible to deduce both that 



EV+E 



(BA) 



Tr 



< 



(40) 



(by using a process for which either pab = 1 or pba = 1) 
and that 



r\PAB)+f-\PBA) >J2 



(41) 



Equation [40] implies the existence of the thermodynamic 
entropies {Sg{X)}, as before. Equation HT] implies the 
existence of a convex set of functions of state {S^{X)}, 
which will be called the fluctuation entropies, and which 
all satisfy 



J 



^(AB) (AB) ^(BA) 

Y: — r\PAB) < sm - s,{A) < r\PBA) - E r 



(BA) ^ JBA) 

T~ 



(42) 



In order to narrow down the range of permissible en- 

JAB) JBA) 

should each be 



tropics, the terms J2i 



andX;^ 



as large as possible, subject to the constraint of Equation 



001 



This produces the following entropy fluctuation law: 



Let qI^^'' be the heats extracted from heat 
bath at temperatures T^, by a process, which 
occurs with probabihty one, whose sole other 
result is to transform state A into state B, 

and which maximises the value of — 
over all such processes. 

There exists single valued functions of state 
{S^{X)}, such that, if there exists a process 
occurring with probability p, whose sole re- 
sult is to transform state A into state B, 
while extracting quantities of heat, Q'f^^\ 
from heat baths at temperatures T;, then 



10 

and Se{X) e {S^X)}. If both Se{X) and S^X) 
are uniquely defined, then -^JT — — / (pab) + 

Y.i^, / (pba) = 0, in which case SeiX) = 

S^{X). However, in general, if the thermodynamic en- 
tropies {Sg{X)} are not restricted to a single globally 
unique function, then there may exist Sg{X) ^ {Stj,{X)}. 
It is worth noting that Equation 1481 implies 



(AB) 



T,, 



f-\pAB)+J2 



Q 



(BA) 



T, 



r\PBA) 



< 



S^iA)<S4B) + r\p)- 



Q. 



(AB) 



i 



(AB) 



(43) 



If, on the other hand. Equation 

(AB) 

cycle, for which also h 

requires 



(49) 

mi holds for fluctuation 

(BA) 



To restrict these to a unique function S,f,{X) requires 
that there exist cycles^ for which 



){AB) 
'_i 



r\PAB) + 



E 



f-HpAB) + rHPBA) 



E' 



JAB) 



(AB) 



Q 



{BA) 



T, 



(44) 



r\pBA)>Q 

(50) 

(Byjp other words, if there exist any fluctuations from state 

A to state _B, and vice versa, that can define a imique 

fluctuation entropy difference S^{B) — S^{A) when com- 



2. Reversible Paths 



If it is the case that the equality in EquationHOlis met, 
then Equation |4l] takes the form 



r\pAB) + r\pBA) 



> 



Q 



(AB) 



E 



(BA) 



(45) 



and 



E- 



T, 



-r\PAB) < s^{B)-s4A) < r\PBA)~Y. 



Q 



(46) 

This is not sufficient to ensure S^{B) — 5*0(^1) is unique. 
However, in this case, it is possible to deduce the ex- 
istence of the globally unique thermodynamic entropy 
from the reliable paths 



bined with a reliable but irreversible cyclic path between 
A and B, then it must be the case that there are no re- 
liable, reversible cyclic paths between states A and B. 
The existence of a globally unique 5*0 (X) that is not 
simultaneously a globally unique Sg{X) would imply re- 
liable, reversible processes cannot exist. 

Reliable, reversible cycles imply an entropy fluctuation 
law: 

There exists single valued functions of state 
{S^{X)}, such that, if there exists a cyclic 
process, occurring with probability one, op- 
erating between states A and states B, with 
a zero net extraction of heat over the cycle, 
then for any other process, occurring with 
probability p, whose sole result is to trans- 
form state A into state B, while extracting 

quantities of heat, qI'^'^\ from heat baths at 



(BA) 



T, 



temperatures T,;, then 

S^{A) < S^{B) + r\p) 



E 



(AB) 



(51) 



Se{.B)-Se{A)^Y.' 



^(AB) 
■H 



E- 



^(BA) 



T, 



(47) 



for which Equations [35] and [31] give 



(AB) 



-r\pAB) < Se{B)-Se{A) < r\psA)-Y, ' 

(48) 



JBA) 



and there is a globally unique thermody- 
namic entropy Sg{X) e {S^{X)} 



3. Exponential Statistics 



Finally, note that if the fluctuation law takes the ex- 
ponential form discussed in Section UlI H| then 



^ When dealing with fluctuations, a cycle is a process for which 
the system starts in state A with certainty, reaches the state B 
with probability PAB, and then the conditional probability for 
returning to state A, given that it reached state B, is Pba- 



r\pq) = f-\p) + r\q) 

so Equation [36] leads immediately to 



r\PAB) + r\pBA)>J2 



(AB) 



T, 



E- 



(52) 



(53) 
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This gives Equation 1481 without needing the existence of 
reUable paths. This imphes there exists a convex set of 
fluctuation entropies {S,j{X)} C {S^{X)} satisfying 



A. Maximal Fluctuations 



[AB) 



T, 



-r\pAB) < Srj{B)-S^{A) < r'iPBA)- 



The definition of the / function is such that there must 
((gcji^t some process for which the equahty in Equation [57| 
^is met: 



* ^ j 

(54) 

Uniquely defining an Sri{X) entropy would require 

- f-\PAB) + ^ - rHpBA) = 0, but 

this does not necessarily uniquely define either S^{X) or 
Se{X). In this case, however, if a unique Scf,{X) does 
exist then it is necessarily equal to a unique and 
vice versa. 



V. FROM FLUCTUATIONS TO STATISTICAL 
MECHANICS 

The possible relationship of the fluctuation spectrum 
/ to statistical mechanics will now be briefly explored. It 
will be assumed throughout this Section that a globally 
unique entropy S{X) — Se{X) = S^{X) can be deter- 
mined, and only a single heat bath at temperature T 
will be used. The entropy fluctuation law now takes the 
form: 

There exists a single valued function of state 
S{X), such that for any process, occurring 
with probability p, whose sole result is to 
transform state A into state i?, while ex- 
tracting quantities of heat, Q^"^^\ from heat 
baths at temperatures T, then 



SiA)<S{B) + r\p) 



T 



(55) 



Suppose the system is in an initial state, with entropy 
S, internal energy E, and is subject to a process during 
which it fluctuates to state a with probability pa ■ During 
the course of the process, heats Qa are generated in heat 
baths at temperatures T and requires work Wa to be 
performed. 

By conservation of energy, the internal energy of state 
a is 



(56) 



By the entropy fluctuation law, the entropy of state a 
must obey 



S<S^ + f-\p^)-^ 



(57) 



This equation must hold for each possible fluctuation 
away from the initial state, so that 



S<Y.Pc^{s^ + f-\p^)~^ 



(58) 



necessarily holds. The form of this constraint is very 
suggestive of entropy functions that occur in statistical 
mechanics. 



S = Sa^+r'ipa.) 



T 



(59) 



.«^/((.-f)-(5.-^)) (60) 

However, there is no guarantee that a single process 
can exist which achieves the maximum fluctuation for 
every possible outcome. If such a process did exist, then 



S ^^Pa [Sa + f ^{Pa) 



T 



(61) 



would hold. 

This similarity to statistical mechanics is brought even 
closer under two conditions: 

1. If a set of maximal fluctuations occur which do 
not generate heat, on average, then J2aPo^ — 0- 
The entropy formula then becomes: 



(62) 



2. If a set of maximal fluctuations can take place, 
without requiring external work to be performed 
(Wc, = 0) then: 



Pa = f[[S-§;)-U-f 



or Pa = t" ), where 



(63) 



F = TS-E (64) 
= TSa^-Ea (65) 

B. Example fluctuation laws 

Let us consider the functions from Section UlI HI 
1. f(x) = 

(a) fe{x) — e~°^^. This generates the familiar 
Gibbs canonical statistics. 



ai 



(66) 



S = y'pQ'Sa - — p„ Inpa (67) 

(68) 

with Ze = e-^i^/^ = e-"i^°/^ 



Pc. = 



(b) Mx) - (l + aix)-i 
a-i 



' ^ n 1 



Po 



a 
1 



ai 

(l + ai/3F„)-i 



(69) 
(70) 



(71) 



with N the number of distinct states in the 
summation, Z., = (1 + aiF) and /3 = 1/{TZ,). 

(c) /^(a;) = (l + aix)^-^/"!. This generates statis- 
tics similar to the Tsallis non-extensive en- 
tropies. 



1 



ai 



(72) 



5 = (i-Ep^"M (73) 

Q \ Q / 



= — (l + ai/SF^)-!/"^! 



(74) 



with = (1-1- aiF/Tf/''^ and /? = 

i/(rz^-o. 

2. The slowly falling function Ji{x) = (1 -I- ln(l -|- 
ax))~^ yields 



fr\p) - -(e(^-^-i)-l 
ai \ 

Pa = ^(l + ln(l + ai/3F„)i/^')"' 
Zi 



(75) 
-^76) 

" L 

(77) 

with = 1 + ln(l + oiF/T) and /3 = e^'-^ /T 



VI. CONCLUSION 

Starting from the physical intuition that larger ther- 
mal fluctuations must be less probable than smaller fluc- 
tuations, we have suggested a fluctuation law that states 
that for any given size of fluctuation, there is a non- 
trivial maximum probability of it occurring. This sim- 
ple suggestion proves surprisingly fruitful. The equiva- 
lence of the Kelvin, Clausius and Carnot formulations of 
the phcnomenological second law of thermodynamics is 
shown to naturally generalise to the fluctuation law, and 
further constrain it to be of the form: 

There is no process, whose sole result is the 
extraction of quantities of heat, Qi, from 
heat baths at temperatures T^, converting 
the net heat extracted into work, which can 
occur with probability p, unless: 




(78) 
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with the function / further constrained by the require- 
ment 



(79) 



If the underlying dynamics is found to be such that larger 
fluctuations can only occur through the accumulation of 
smaller fluctuations, then this requires the function to 
have the exponential form: 




/ 



(80) 



It is interesting to note that the phenomenologically mo- 
tivated approaches of Szilard and of Tisza and Quayjljj, 
12] to statistical mechanics derive the canonical distri- 
bution by making a similar assumption (see also [l3|). 

We have further shown that the deduction of the exis- 
tence of a non-decreasing thermodynamic entropy func- 
tion of state may still be followed, to derive a fluctu- 
ation entropy function of state. Under a similar kind 
of circumstance for which the thermodynamic entropy 
can be deduced to be globally unique, then the fluc- 
tuation entropy can be deduced to be globally unique. 
Furthermore, if the thermodynamic and fluctuation en- 
tropies are both globally unique, then they are neces- 
sarily identical (up to an additive constant). This holds 
out hope that more rigorously axiomatic developments 
of the thermodynamic entropy, such as that of Lieb and 
Yngvason[l|, may be generalized in a similar manner to 
incorporate fluctuation phenomena. 

Some possible forms of the entropy fluctuation law 
have been investigated. The exponential form naturally 
produces the Gibbs canonical distribution for thermal 
fluctuations. Non-extensive entropies, such as the Tsal- 
lis entropy, can also be seen to arise naturally in this 
approach. Further investigation is needed to explore the 
consistency of different / functions. In particular, the re- 
quirement that the mean heat extracted over a cycle is 

non-positive, l^Ylii Oj may be expected to further 

constrain which functions are admissible. 



APPENDIX: ENTROPY FUNCTIONS FOR 
IRREVERSIBLE CYCLES 

Suppose there exists a path dependant quantity, 
(a property of a particular path A, in a state space, from 
state A to state B) well deflncd for all paths A, states A 
and states B, for which: 



VA,A' 



(A.l) 



and that there exists at least one path from each A to 
each B for which the corresponding value of f2 is finite, 
so that infA [S^;^^] ^ Then there exists a non-empty 
convex set of functions of state {S{X)}, such that for all 
paths A and states A and B: 



S{A) < S{B) + Q 



AB 



(A.2) 



So > ilAB- 



Proof: Define Qab = infA 

As fi_BA < C!0 and ilAB > —^ba, then flAB > —oo. 

By definition, the minimum value of il going from A 
to C cannot be more than the value going from A to C 
via a path including B: 



^AC < ^AB + ^bc 



(A.3) 



so 



^AC - ^AB < ^BC (A.4) 

Qab ~ ^AC > ~^BC (A.5) 

^AC-^BC < ^AB (A.6) 

^BC ^ ^AC > ~^AB (A.7) 

Define the set of functions of state {S'iy(X)} by 



S+a{X) 
S-a{X) 



^XA 
— ^AX 



(A.8) 
(A.9) 



These are clearly well defined, finite functions of state, 
and they exist, so the set {S'iy(X)} is not empty. Note 
that as ^xx — 0: 

^XY = S+y{X)^S+y{Y) (A.IO) 
= S-x{X)-S-x{Y) (A.ll) 



and 



S+a{X) - S+a{Y) = Qax-^ay 

S-a{x) - S-a{y) = -nxA + nvA 



It follows that for any A, 



S+a{X) ^ S+a{Y) < rixy^. 



> 



<^X. 



S-a{x) - S-a{y) < nxY<n 



A 

XY 



> -^YX > 



A 

YX 
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(A.12) 
(A.13) 



(A. 14) 
(A.15) 
(A.16) 
(A.17) 



and it is then easily demonstrated that for any distri- 
bution X^iy ^(*^) = 1' w{iY) > 0, that the weighted 
function of state 



lY 



satisfies 



as 



S{A) - S{B) < n\s 



(A.18) 



(A.19) 



YX 



YX 



S+x{X) ~ S+x(Y) < S,a{X) - S,a{Y) < S+y{X) - S+y{Y) = nxY<n 



A' 

XY 



(A.20) 



r 



Note, that the set {^-y does not neces- 

sarily include all the functions which satisfy the inequal- 
ity of Eq. (jA.2p . It only demonstrates the existence of 
a non-empty set of such functions. 

It is now a trivial matter to show from Equa- 
tion IA.20I that, whenever the equality in Equation 
lA.ll can be reached, that all functions in the set 
{^-y u'(iF)S'iy(X)} (indeed, all functions satisfying 
Equation IA.2[) will give the same entropy difference be- 
tween states A and B. By extension, if the equality in 
Equation I A. II can be reached for all pairs of states, then 
there is a single function, S{X), unique up to an additive 
constant. 
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